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VBSTRACT ■ 

QOESTA II assesses the .high school environ«ent in 
teris of values, attitudes, expectations, and levels of satisfaction 
thrpugh students* and faculty's perceptions*:^^^^^ 

jprpvides inforiation about how the students ''feei"iatput^theiseives, 
and their relationships with their teachers,^ administrators, and 
classiates. Since tite T96'9-70 school year, QOESTA II has keen 
adiiinistered biannually to all 11th grade students and to all faculty 
■eibeirs in order to: (1) learn lore about the students and staff and 
also the characteristics of the school environient ; (2) discoveir ipre 
about how the school functions; (3) identify those factors in the 
affective doiain which are influencing learning; and (4) idjentif y the 
school's strengths and weaknesses. The paper describes how one school 
Mstrict has utilized QOESTA II findings to provide relevant data for 
both inforiation and discussion sessions at school-coiaunitj self 
evaluation conferences and to provide inforiatibn that focuses on 
action needed to liprove the school's environient. QOESTA II lay also 
be used as a suppleient to Pennsylvania's prograi of Educational 
Quality Assessient or to construct the needs assessient for a Title 
III. prograi. The paper includes the procedures used in adainisterin? 
QOESTA II, the plan used to translate the results into a Meaningful 
qualitative report, and a saaple of the developed fori froi the Ajpril 
1974 adiinistration. (Author/BJG) 
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utilization of QHESTA II > An Affective Assessment of School Environment 

During the 1969-70 school year, the Mt. Lebanon School District Incor- 
porated Into Its standardized testing program QUESTA II. QUESTA II, a non- 
cognitive, affective area questionnaire. Is designed to assess the human 
environment within the school. This Instrument assesses the school environment 
in terms of values, attitudes, expectations, and levels of satisfaction through : 
teachers* and students* perceptions. It also provides Information about how the 
students feel about themselves and their relationship with their teachers, 
administrators and classmates. In essence the survey attempts to provide the 
students V and educators* perceptions of the operation level of the school by ^ 
providing Insight Into the jiature of learning and conditions affecting learning 
in the school setting. This questionnaire is written anonymously and usually can 
bVcpn?)leted in less than 60 minutes. It is designed for use at the high schppJ 

level.. : \ ; , . ; , ^ r ; 

Since May 1970, QUESTA II has been administered every two years to all 
eleventh grade students and to every member of the high school faculty. 

QUESTA II was adopted because thiB District's staff recognized the need for 
the school not only to be concerned regarding our students' development in the 
cognitive and psychomotor dotiain, but also in the affective dopiain. It was 
recpgnlzed that a need existed to identify more accurately and with greater 
precision those things in the affective domain which are influencing learning at 
the high school level. Eleventh grade students were selected because of their 
familiarity with the high school program. Twelfth grade students were not 
selected because it was thought that their interests would be focused on their 
approaching graduation. In addition, eleventh grade students would be able to 
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be appraised of the results and to be Involved in any evaluation in the - 

following year. Finally, eleventh grade students participate in the state -s 

Educational Quality Assessment (EQA)» and data from QUESTA II is considered to 

be a valuable complement to EQA. Administrators do not write QUESTA II because 

they are so few In number that their individual pattern of responses could be 

easily identified on the stunrcaiy sheet. 

The Mt. Lebanon School District believes that the community has a rigjit 

to know about the environment within the school and to accomplish this objective 

the District sponsored in 1971 its first Self-Evaluation Conference. The purpose 

of this program was to provide to representatives from the total community as 

accurate a picture as possible of the life blood of the school. Specifically, 

through tbis self evaluation program, the District set out to: 

z 1 . share and exchange information about the school with a 
; wide section of the school and conmiunity population. 

'2. learn more about students' and staff s| per cepti^ 
cbcpectations^ and satisfactions in the' school. 



3 . learn more about school expectations of community at large . 

4. learn more about the attitudinal characteristics of each 

/ : school "as a COTimunity." ^ V ' 

/ 5. gain some insights into how each school functions. 

6# assess each school's strengths and weaknesses. / . 

7. identify possible factors Which are responsible for the 
strengths and make certain their use is rei^^^^ 
suggest approaches to the solutions of the problems and to 
plan useful next steps (to make these suggested solutions 
a reality) . 

Since May 1971, these conferences have been scheduled bi-annually and in 
the past the findings from QUESTA 11 have been used as structure for the 
.conference. In February 1975, the District has scheduled its "Third Self- 
Evaluation Conference." During this conference the findings from the 1974 



administration of QUESTA II and the 1974 administration of the state Educa- 
tional Quality Aiipessment will be used to provide relevant data for both the 
Information and discussion, sessions « : 

When the Mt, Lebanon School District went to the community and asked^ them 
to support a 1^ million dollar bujldlng program as; an addition to the present 
high school plant 9 a commitment was made that the proposed educational setting 
would allow the creation of a program wherein it would be possible to indivlduaiize 
and humanize instruction for every student. To justify this expenditure a need 
exists to periodically evaluate the degree to which this obligation is being 
fulfilled. It has been found that a summai^ of the analysis of sections of 
QUESTA It have helped in the determination of whether this commitment is being 
fulfilled. The summary of QUESTA findings have made the District ^ware of strengths 
and wedknes^^ in its attempts to become more humane. QUESTA II has provided data 
with which to consider conditions which have demanded the school's immediate 
^ ^ OMasiderati^ 1 j ^ , r — : \ 

The legislature of the State of Pennsylvania has mandated an evaluation 
program known as Educational Quality Assessment (EC{A). This program is administered 
every three years in every school district in grades 5, 8, and 11. The purpose of 
this assessment program is to provide the local school district with objective 
information related to the cognitive and affective areas about the quality of their 
school programs. This iiiformation is to be used to appraise a schopl^s programs 
and to develop plans to Improve or strengthen them. Educational Quality Asses smei^t 
is based upon the Ten Goals of Quality Education which identifies the extent of a 
student's development in three areas of the cognitive domain and in seven areas of 
the affective domain. The affective areas are self-esteemy understanding others, 
vocational attitude, appreciating human accomplishment, interest in school, 
citizenship, creative attitudes, and preparing for a changing world. 
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Acquaintanceship with the content^ construct, and rationale of both 
Pennsylvania's Educational Quality Assessment and QUESTA II allowed members of 
District staff to recognize that in many instances both instruments were assessing 
the same areas* The staff believed that QUESTA II had the capabilities of providing 
more in-depth information in the identified affective areas than EQA. Therefore, 
it was decided that QUESTA findings would complement the findings from the state's 
assessment program. Last year, to accomplish this objective QUESTA II was. ad- 
ministered to the same high school population who wrote EQA. An expert and 
authority on EQA has complimented the District for this pattern of testing stating 
that he also believed that the findings from QUESTA can be used to supplement and 
make more meaningful the findings of EQA. During the month of October, the High 
Schoor Principal, the Director of Instructional Services, and the Coordinator of 
Pupil Personnel Services matched the items of QUESTA ltd. th the specific scales of 
EQA as defined by its program authors* This exercise coiofintted that the areas 
tapped by QUESTA II were related to EQA. In Chart I the specif ic goal areas of 
EQA are identified and the number of items in specific sections of QUESTA thit 
were f oisnd to relate to the specific EQA areas are listed for each EQA goal. 
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CHART I 

AREAS OF QUESTA RELATED TO EQA GOAL AREAS 
EQA GOAL I - Self Esteem 

QUESTA Areas Number of. Items 

General Satisfaction Level 1 
Opinions About Purposes of the School 2 
Effects of the School on the Student 5 - ; _ ~ { 

Personal Values and Life Goals 9 
Pressures on the Student 5 
Rules and Regulations 1 

. Total 23 

EpA GOAL II - Understanding Others 

- QUESTA Areas Number of Items 

Opinions About Purposes of the School 2 
Effects of the School on the Student . 1 
PersQimi Values Life^ Goals X ^ ^ 

Personal Relations and Com^ 1 
R^litiohs Between Racl^^ 1 \ 

Pres^sures on the^tudent ^ 3 

! : o ^ ^ r - -- -:--- -[ _ Total 9 v :v 

' \ EQA GOAL IV - Interest in School 



4 ^ _- 
/ - 
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r QUESTA Areas 


Number of Items 




General Satisfaction Level 


1 - ^ ^ 




Opinions About Purposes of ^ 


2 




Effects of the School on the Student 


1 




Personal Relations and Communications 


9 . 




Governance of the School 


10 




Perceptions of Change 


16 ■ 




Teachers in the Classroom 


17 . 




Grading 


12 ■ 




The Curriculum 


A - 




Extra Curricular, Including Athletics 


8 




Counseling 


31 




Rules and Regulations 


2 






Total 114 




EQA GOAL V - Citizfmship 






QUESTA Areas 


Number of Items 




Opinions About Purposes of the School 


3 




Effects of the School on the Student 


4 




Personal Values and Life Goals 


3 • 




Pressures on the Student 


3 




Rules and Regulations 


20 






Total 33 




. - 7 


- i- _-" - 


-- ^ 







- ' CHART I (Continued) 




: " . y * AREAS OF QUESTA RELATED TO EQA GOAL AREAS. 




\ EQA GOAL VI - Health Habits 




QUESTA Areas ; ^ 


Number of Items 


' ^Tobacco, AlcQholand^ Drugs - ^ 

^ ~ 5^ ; - : : Total 


11 ■ ' 

V 1 

12 " 


< EQA GOAL VII Creative Attitude 




• - QUESTA Areas ' r ^ 


Number of Items 


Opinions About Purposes of the School 
.-Personal Values and Life Goals ^ ^ ; 

T The Arts ? ^ ^ ^ - ; 

^ ^ , ^ Total 


1 
2 
2 
5 


; .. .. :j EQA GOAL VIII - Vocational Attitude 




Number of Items 


Opinions About - Purposes of th^ School 

-5 : Eff ect^^^^^^ on the Student > 

-^^^^^^^^ :^ 
- ^ r : . '- - - - Total 


2 
1 

■ 1 
A 


7 ^ ^> ^ EpA GOi^ IX - Appreciating Human Accomplishments 


^> : ^^lUESTA Am - ^ - 


Number of Itans 


Effects of the School on the Student 
- ^The Arts * 
. " ^ ' / ; , : Totat 


■ 1 ' 
5 
6 


----- *^ . ^ ' ^ _ - - - - - 

EQA GOAL X - Preparing for a Changing World 


QUESTA Areas 


Number of Items 


_ _ - _ - _ - _ _ i : 

Opinions About Purposes of the School 
- ^^Effects of the School on the Student — 
Personal Values and Life Goals- 
v: " Total 


2 
2 
1 
5 



-- 
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the District supplements its report of EQA findings with the appropriate 
knowledge and information gained from administering QUESTA II* 

During the 1974-75 school year the District found another us^ for QUESTA 
11 results. It was recognized that within th^ content of QUESTA II is a built- 
in needs assessment program. The District staff used the 1974 QUESTA findings 
to construct a rationale for a title program related to vocational counseling. 
Justification for the need was found in analyzing and evaluating QUESTA II data. 
A section of the report that was formulated appears in Charts II, III, and IV. 
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CHART II 

1974 QUESTA FINDINGS (MT. LEBANON SCHOOL DISTRICT) 

^ QUESTA AREA 
Opinions About l^urpose of School 



Question 

- to help students 
prepare for jobs 

- to help students 
fulfill themselves 
as persons 

+ to help students 
get Into college 



- to prepare students 
to: cope effectively 
with outside world 



Keyt 



+ over emphasis^ 
—under emphasis 



Question 



Respondents 

students 

teachers 

students 

teachers 

students 
teachers 

students 

teachers 



Response Pattern 
Percent "yes" answers 

happening should 



35 
25 

20 

39 

78 

20 
20 



72 
61 

68 

87 

62 
48 

74- 

86 



QUESTA AREA 
Effects of School on the Student 



helps students to know 
about j obs after graduation 



Respondents 
students 



Response Pattern 

79% stated school had little 
or no influence 



Quels tion 

most important source 
/i>f morale and spiritual 
values to you " . 



/ QUESTA AREA 
Personal Values/Life Goals ' 

Respondents 
students 



Response Pattern 

Parents 60% 

Peers 62% 

Self 66% 

Teachers 12% 

Counselors 7% 
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CHART III 

1974 QUESTA FINDINGS (MT. LEBANON SCHOOL DISTRICT) 



QUESTA AREA 
Counseling 



Response Pattern 
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fairly good 


Question 


Respondents 




Helping choose occupations 


students 


63% 




teachers « ^ 


57% 


Helping to select courses 


students 


80% 




teachers 


72% 


Question 


Respondents 


Response Pattern 

Expression of Belief ; . _ r 


Shouf d the school provide 
Infoinnation, cout^^ or 
courses In area of choosing 
occupacxon 


students 
teachers 


89% V 

" 90% \' 


V question 


Respondents 


Response Pattern ;> 
Percent of tiiies selected " 


Wno would ask about finding 
a job after graduation 


^students 
QUESTA AKEA 


self knowledge 36% 

parents r zu* _^ ^ : 

counselors 12% 


question 


Pressure on Students 
Respondents 


Response Pattern Category : 
Bothered very much 


Concern about getting 
Into college ^ 


students 
. teachers 


; 46% - - . 

] 58% . ; ' 


Pressure from parents 


students 


; - 27% . ; 




teachers 
QUESTA AREA 


52% - 


Question 


General Satisfaction Level 
Respondents 


Response Pattern Category 
Agree Strongly Agree 


Experience In this school 
a good one 


students 
teachers 

It 


62% 19% 

33% 62% - 
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CHART IV 

CONCLUSIONS FROM 1974 QUEStA FINDINGS (MT. LEBANON SCHOOL DISTRICT) 
The following conclusions were derived from the data: 

1. The school has little Inflaence in: , ; 

helping students prepare to cope with the outside 
world, 

giving information about jobs after graduation* 

2. The school should do more to help students: 

prepare for jobs, 1 

fulfill themselves as persons, 

cope with the outside world • 

3. The school is doing too much to help students prepaire _ ^ 

for college • ^ 

Most students experience pressure about getting Into :: : 

- .-_ ' y ' college. / 

Parents, peers and self knowledge rate higher than 
counselors and teacherr as a source of values and help 
in: finding a job. Tet, students have good communications 
with counselors and teachers. 

5. Students expect counselors to assist them with course j 
selections and college admissions. They expect the ^ :\ 
entire- school program to help them with choice of : 
occupation, preparation for a job and development of 

skiirs to cope with the outside world. 

6. Teachers overestimate the amount of pressure students 
experience about the need to be* admitted into college. 

Teachers overestimate the amount of pressure placed on ^ 
students by their parents. 
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Jhe District recognizes that before anyone is asked to participate in 
,any type of assessment program there is a need to foster in the respondent 
the correct mental set and a constructive attitude toward the assessment program. 
Before administering QUESTA II the administration explained to the student 
body and the faculty: What i« QUESTA II? Why QUESTA IT? What does the school 
plan to do with the results? It was also mentiom thtise meetings how the 
District planned to share the information that was learned from the program. In 
this meeting the procedure adopted to assure anonymity of response on the 
questionnaire was also explained. To accomplish this task the building principal 
and the psychologist met to explain this assessment program with two selected 
student leaders from each eleventh grade homeroom. The student leaders carried 
what, they had learned from this meetlr^s back to their fellow homeroom students. 
The house principals met with each of their respective faculties to explain the 
program. In the explanation meeting the students exhibited a high degree of 
interest in all aspects of the evaluative program. The teachers were most 
cooperative. It is to be noted that no problems were encountered during the 
administration of QWESTA II and that 100% of the teachers returned their 
completed questionnaire without the need of any type of coercion. 

The District has always made use of the QUESTA II comment sheet, an 
optional unstructured supplement to the inventory. The students have always 
made extensive use of this sheet. The content of their comment's points out that 
•the questions of this questionnaire serve as stimuli for their runarks. The 
students' remarks are frank, open, very exact, and of ten expressed in great 
detail. Our students were willing to point out what was good and bad about 
programs, teachers, any innovations and the questionnaire. An interesting 
note is that those teachers who are rated unsatisfactorily by the administration 
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during the 1973-74 school year received a significantly greater number of 
negative criticisos than other members of the faculty. In September the comment 
sheets were reviewed by the high school administrative staff. Their criterion 
for determining validity was the number of instances that a particular comment 
was made. After reviewing the contents of the comment sheet, the high school 
staff remarked that the comment sheets make very interesting reading; however , 
sometimes depressing, they are for the most part constructive and are very 
enlightening and demand constructive action. 

Following the administration of any assessment program, it is the 
policy of the School District to publish a qualitative report for distribution. 
Following the April 1974 administration of QUESIA II, as in the past two 
administrations, the summary of QUESTA II findings has been prepared. This 
summary was prepared through the team efforta.of two high school counselors, the 
secondary school psychologipt, and the Coordinator of Pupil Personnel Services. 
An example of this summary is presented in Charts V and VI. 
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CHART V 

OPINIONS ABOUT THE PURPOSE OF THE SCHOOL 

A majority of students and teachers feel that the school is not but should strongly 
emphasize helping students of different races get along together. 

The following are purposes which the school should have that the students and 
teachers feel should have much stronger emphasis: 

Help students prepare for Jobs.^ 

Help students discover and fulfill themselves as persons. ' 

Help students discover and develop their creative ability. 

1 

Help students be concerned for the needs of others. 

3 

Help students gain understanding and respect for the rules of society. 

3 

Prepare students to play an active role as citizens. 
Prepare students to cope effectively with the outside ^world. 
Help students become independent , thinkers. 

The following are purposes which the school should have that students and teachers 
feel should have more emphasis: 

Help students discover and develop their intellectual abilities. 
Give students specific knowledge and skills. 

A majority of the students and teachers believe that the school should t;ry to 
foster the ethical growth of its students, but the teachers feel more strongly 
about this than the students. 

The majority of students and teachers expressed general satisfaction that helping 
students improve their social and economic status is being properly (moderately) 
emphasized. 

Both students and teachers, while agreeing on its importance, would like to see 
less emphasis on helping students to get into college, particularly prestigious 
colleges. This feeling was strongly expressed by teachers. 

Both students and teachers agree that the need to prepare students for work they 
will face in college is important and is being met, but the teachers feel that 
there should be less emphasis. 

Both students and teachers feel that there is a moderate emphasis of the need to 
help students develop leadership ability, but teachers see a need for much greater 
emphasis. 



"Slore girls than boys see a need for this emphasis. 

^at the students and teachers understand this statement to mean should be 
discussed at the self -evaluation conference. 

^re teachers than students see the need for much stronger emphasis. 

15 



CHART VI . 
EFFECTS OF THE SCHOOL ON THE STUDENT 

The majority of the students feel tHat their school has positively influenced 
their progress in: 

* Improving my sense of responsibility. 

. * Improving my ability to think and solve problems. 

* Developing the ability to follow through with a project, interest or task. 

* Understanding science, math, English, and other academic subjects. 

* Increasing my desire to learn. . 
Improving my self-confidence. 

Improving xssy ability to get along with other people. 
Helping me to appreciate the arts. 
Knowing about jobs after graduation. 
Becoming politically aware. 
A majority of the students feel their progress has not been influenced in: 

* Preparing for marriage and children. 

^Learning to make better/distinctions between right and wrong. 

* Getting along well with my parents. 

* Becoming independent of my parents . 

* Understanding people who differ from me in racial or ethnic background. 
Being independent of the opinion of other students. 



* Response patterns are signf icantly greater than 50% 
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With this summary as a guide the high school principal appointed five 
committees to study this report for their findings and suggestions for 
Improvement. The committees were comprised of administrators, subject area 
coordinators, teachers and students. Placement on a particular committee 
was related to particular professional assignments or interest • Each 
conmdttee reviewed particular sections of QUESTA with no committee reviewing 
more than three sections of QUESTA, The committees and their assignments 
are presented in Chart VII. 
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CHART VII 

COMMITTEE TO STUDY QUESTA II FINDINGS 

The Committee on Purposes and Goals will review the report and QUESTA 
data on the following sections: 

Item Grouping 

Purposes of the School 
Effects of the School on the Students 
* General Satisfaction Level 

The Committee on Personal Relations and Communications will review the 
report and QUESTA data on the following sections: 

Item Grouping 

Personal Relations and Communications within the school 
Governance within the school 
Pressures on the students ^ 
Rules and Regulations 

The Committee on Curricultiwand Instruction will review the report and 
QUESTA data on the following sections: 

Item Grouping 

Teachers in the Classroom 

Grading * 
The Curriculina 
Perceptions of Change 

The Committee on Counseling and Pupil Concerns will review the report 
and QUESTA data on the following sections: 

Item Grouping 

. Counseling 

Tobacco , Alcohol and Drugs 

Relations between Racial, Ethnic Groups 

Piclrsonal Values and Life Goals 

The Committee on Extra-Curricular Activities will review the report and 
QUESTA data on the following sections: 

Item Grouping 

The Arts ^ 

Extra-curricular Activities > including Athletics 

After studying the data they will ^® charged to: 

1. evaluate the draft 

2. make necessary elaborations 

3. formulate recommendations for their committee reports 

The five committee reports combined with the original committee report 
will serve as the final assessment report to the staff and the community. 
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Some of the more significant findings from the Mt. Lebanon administration 

of QUESTA II follow: 

1. . 81% of the students agreed that in general their own experience 
in the school had been a good one. 

2. When questioned about the purposes of the school, students felt 
stronger emphasis should be placed upon preparing students for 
jobs and helping students cope effectively with the outside world. 

3. Significantly more of the students believed that the school has 
positively influenced their progress in the ability to think and 
reason than it had provided knowledge about jobs after graduation. 

4. From the listing of 13 personal values and life goals our student 
response pattern revealed that they ranked personal happiness most 
essential and being active in politics as least essential. 

5. Our students listed their own thinking, student friends, and 
parents as the primary source of their moral, spiritual, and 
ethical values. 

6. More than 75% of the students agreed that students have enou^ 
freedom to choose the courses they want; that the school off ers a 
good range and variety of courses; that the courses develop the 
ability to analyze and criticize written and visual materials; 
and that most courses offer useful knowledge or develop useful skills 

7. Although 80% of our students agree that the school offers enough 
opportunity for participation in the arts, active participation is 
less than 10% in every area except creative writing. 

8. A majority of the students felt that hard work, actual knowledge of 
subject matter. Intelligence, and talking a lot in discussion are 
very important in getting good grades. 
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9. 85% of the students and faculty believe that the school board 
and administration have the greatest influence in how the school 
is run. 

10. 90% of the students and faculty agree that students should have 
a voice in determining currioulum» and 60% of the students 
believe that they have reasonable opportunities to influence 
change in the; school* 
11* 71% of the teachers felt that the relationship between teachers: 
and administrators is good. (A significantly greater percentage 
than was f oiind in the two previous administrations) • 
The Mt. Lebanon School District does not believe that QUESTA II is a 
panacea to solve all of our problems* It is recognized that it offers no / 
foolproof formulas for improvement* It does offer the school an unparalleled 
vantage point for looking at Itself - an information base which is really only 
the starting point for self-analyses* The information base is formulated by 
providing the faculty and students the opportunity to honestly express their 
feelings, opinions, concerns, and insights* QUESTA II has not performed miracles 
but in the company of other measures and observations^ a profile has been drawn 
of the high school* The Insights provided by the objective Information in the 
school report, combined with the intimate knowledge of the school which the 
staff, student, and the community possess have served as a guide in formulating 
recommendations which are bringing the goals and objectives of the educational 
program closer to reality* 
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